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Abstract 

Evolving networks with a constant number of edges may be modelled using a 
rewiring process. These models are used to describe many real-world processes 
including the evolution of cultural artifacts such as family names, the evolution 
of gene variations, and the popularity of strategies in simple econophysics models 
such as the minority game. The model is closely related to Urn models used for 
glasses, quantum gravity and wealth distributions. The full mean field equation for 
the degree distribution is found and its exact solution and generating solution are 
given. 



Networks with a constant number of edges that evolve only through a rewiring of 
those edges are of great importance, as exemplified by Watts and Strogatz [Ij. Many 
different applications may be modelled as a network rewiring: the transmission of 
cultural artifacts such as pottery designs, dog breed and baby name popularity 
O m m [5] , the distribution of family names in constant populations [7], the diversity 
of genes O [9] and the popularity of minority game strategies [10] . There is a close 
link to some models of the zero range process |llj and the closely related Urn type- 
models used for glasses [HI [13] , simplicial gravity [H] and wealth distributions [15] . 
The rewiring of networks is also studied in its own right [H \TE[ [T7] . 

However previous analytic results for network rewiring models are based on 
incomplete mean field equations and their approximate solutions. In this letter I 
give the full equations for linear removal and attachment probabilities with their 
exact solution. This means the analytic results for rewiring models can match the 
status of those for random graph and growing network models (e.g. see |2j). 

Consider the degree distribution of the artifact vertice^, n(/c), in the bipartite 
graph of Fig. [H At each time step I make two choices then alter the network. 
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The artifacts may be a dog breed, baby name or pottery style with each individual choosing one type 
of artifact as indicated by its edge [31 HI [SI [S] . For family names the individuals are those who inherit 
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Figure 1: In the abstract form of the model, there are E vertices of one type — 'individual' 
vertices. Each has one edge which runs to one of vertices of a second type — the 
'artifacts'. The degree of the artifact vertices is k indicating that one artifact has been 
chosen by k distinct individuals. The rewiring will be of the artifact ends of the edges, 
so each individual always has one edge. 

First I choose one of the E individuals at randonjl, aiming to rewire the artifact 
end of the chosen individual's one edge. Thus the edge to be rewired is from an 
artifact chosen by 'preferential removal'. 

Second, this edge will be reattached to one of the artifact vertices chosen 
with probability Ha- With probability preferential attachment is used to choose 
the artifact. This is equivalent to choosing an individual at random and copying 
the current artifact choice of that individual. Alternatively with probability pr 
an artifact is chosen at random to receive the rewired edge. This corresponds to 
innovation in the context of cultural transmission [31 [5], in gene evolution it is 
mutation [3 [9]. 

With only these types of event, Pp + Pr = 1, the number of artifacts A^ is 
constant, and 

nfi = |, UA=Pr^+Pp^, {0<k<E). (1) 

After these choices have been made the rewiring takes place. The mean field equa- 
tion for the degree distribution for (0 < k < E) is therefore 

n{k,t + 1) - n{k,t) = 

n{k + 1, t)UR{k + 1) (1 - UA{k + 1)) 
- nik, t)UR{k) (1 - UAik)) - n{k, t)UAik) (1 - nR{k)) 
+ n{k-l,t)nA{k-l){l-Uii{k-l)). (2) 

This equation holds at the boundaries k = and k = E provided n{k) = IlR{k) = 
^Ai^) = for k = —1 and k = {E + 1) are chosen. Note that by including the 

the name from their partner, the edges are the partners who retain their family name while the artifacts 
represent different family names. For a model of gene distributions [S] in a haploid population, the 
artifacts are the alleles while the individuals are the organisms. A diploid population may be modelled in 
a similar manner. In Urn/Backgammon/Balls- in-Boxes models |121 1131 [HI 115] the individuals represent 
the balls while the artifacts are the boxes. The rewiring of an undirected network is described by the 
same equations provided E is replaced by 2E. 

^In this letter 'random' without further qualification indicates that a uniform distribution is used to 
draw from the set under discussion. 
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factors of (1 — 11^) and (1 — Hr) on the right hand side I am explicitly excluding 
events where the same vertex is chosen for removal and attachment in any one 
rewiring event since such events do not change the distribution. More importantly 
these terms ensure a rigid upper boundary n{k > E,t) = 0. Contrast this with the 
equations for growing networks (for instance in [2]) where there is no rigid upper 
boundary in the long time limit and such terms are absent . These additional 
factors are only significant for k ^ E but they are missing in other discussions of 
rewiring models. The condition E ^ k is usually sufficient for these factors to be 
negligible and results match the literature in this regime. 
These equations ([2]) have a stationary solution if 

n{k + l)UR{k + 1) (1 - UA{k + 1)) 

= n{k)UA{k){l-Un{k)) (3) 

which gives the static solution n(k) for {E > k >0) as 

nik) - ^^ nk + K)T{E + E-K-k) 

K:=PL{k), E:=^E . (5) 
Pp Pp 

The normalisation constant A can be found from (jlU|) below and {k) = E/N is the 
average artifact degree. 

For A; ^ 1, the first ratio of Gamma functions gives 



T{k + K) 
Tik+l) 




(6) 



where 7 = 1 — K < 1. This is consistent with previous results which are usually 
given in a small mutation, ~ 0, and/or low average degree (k) <C 1 limit. 

The novel aspects in the present formulation are the extra factors of (1 — Ha) 
and (1 — 11;^) in ([2D. These lead directly to the second ratio of Gamma functions 
in ^ which for prE > 1 decays exponentially: 

r(E + E-k-k 



r(£ + i-.) -xp{-a-}(i + o(|)) , (7) 

where C = - In (pp) + 0{E-'^). 

However, when prE < 1 the numerator grows with k. In fact at a critical 
random attachment probability, p*, the total distribution stops decreasing at the 
upper boundary, so n(E) = n{E — 1). This occurs at 

* ^ E -1 , , 

Pr - + E{1 - (k)) - 1 - (k) 

Therefore when pr < p* ~ 1/E the degree distribution will increase near k = E. 

Thus there are two types of behaviour. For large innovation or mutation, for 
1 > > E~'^ the distribution is approximately n{k) oc {k)~^ exjp{—(^k}, a gamma 
distribution, with an exact binomial distribution at pr = 1, the random graph case 
of [1]. This gives a power law for small degree, k < ln(p~^), with an exponential 
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Figure 2: Plots of the degree probability distribution function p{k) = n{k)/N and the 
fractional error shifted by A of the data w.r.t. the exact solution. For N = E = 100 
and various Pr = {I — Pp) = 0.1 (crosses, A = 0), 0.01 (circles, A = 1), 0.005 (stars, 
A = 2) and 0.001 (squares, A = 3), while lines are the exact solutions. Measured after 
10^ rewiring events, averaged over 10^ runs. Started with n{k = 1 



n{k) 
plot. 



.) = E but otherwise 
0. The error bars are mostly smaller or similar in size to the symbol in the first 



cutoff for higher degrees. Such behaviour is noted in the Uterature under various 
approximations [H [5l [HI [H [16] and those results are consistent the exact solution 
([4]). However since 1 ^ C impUes (7 — 1) <C (/c), if one had only one data set of a 
typical size, any power law section of reasonable length {k < C~^) "^ih have a power 
7 indistinguishable from the value one (c.f. growing networks where 7 > 2). 

The second regime is where prE < 1, i.e. there is usually no mutation or inno- 
vation over a time period when most edges have been rewired once. Here the tail 
of the distribution rises and one artifact will be linked to almost all of the individ- 
uals. It is the condensation of [13^ [T5] and fixation in [9j but again those results 
were given only for the equivalent of large E. Similar behaviour has been discussed 
for growing networks, for example in [2j, but not as an explicit network rewiring 
problem. 

In this simple model, there are no correlations between the degree of vertices. 
Indeed one need not impose a network structure as in [U [3 [TSj [Ml [15] . Thus the 
mean- field equations should be an excellent approximation to the actual results. 
Numerical simulations confirm this as Fig. [2] and [3] show. 

Given this exact solution for the degree distribution, its generating function 



(9) 



k=0 



may be obtained exactly in terms of the hyper geometric function F{a, b; c; z): 



G{z) 



n{0)F{K, -E;l+K-E-E; 



The m-th moments of the degree distribution are then 
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Figure 3: The degree probability distribution function p{k) = n{k)/N and the fractional 
error shifted by A w.r.t. the exact solution for N = E, Ep^ = 10.0 and Pr = 10~^ 
(crosses, A = 0), 10"^ (circles, A = 1) and 10~^ (stars, A = 2). Measured after 10^ 
rewiring events, averaged over 10'^ runs. Note that for p^ = 10~^ there are signs the 
model may not have quite reached equilibrium. Started with n{k = 1) = E but otherwise 
n{k) = 0. 

In particular the case m = fixes the normalisation, A, of n{k) in while m = 1 
confirms the results are completely consistent in the determination of {k). 

There is another important attachment process that may be included in this 
model. Suppose that with probability p = 1—pr—pp a new artifact vertex is added 
to the network. The new artifact receives the edge removed from an existing artifact 
on the same time step. The cultural transmission models [31 HI El E] and the gene 
pool model studied in [F, U] include this process. In the long time limit the number 
of artifacts becomes infinite, and the random attachment then becomes completely 
equivalent to this process of new artifact addition. This is the large A^, zero (fc) 
limit of the discussion above. Care is needed as n(0) diverges and an alternative 
normalisation is needed. The degree distribution for k > 1 behaves in exactly the 
same way as before, a simple inverse degree power law cutoff by an exponential for 
E{l—pp) > 1 but for £^(1 — pp) < 1 a single artifact is chosen by most individuals. 
Intriguingly for this model when E(l — pp) = pp the degree distribution an exact 
inverse power law for the whole range of non-zero degrees. The exact solution to 
the mean field equations again provides an excellent fit to the data as Fig. U] shows. 

These results have several implications. First I have noted that many apparently 
different models are all equivalent to this simple bipartite network model. Then 
in terms of mathematical detail, previous mean field equations did not include the 
(1— n) terms of Thus exact solutions given here are novel. The various forms for 
the asymptotic behaviour found in the literature can now be seen to be various small 
Pr and/or large E approximations to the exact results, e.g. descriptions elsewhere 
of the condensation regime prE <^ 1 are for large E. Further the calculation of the 
generating function shows that all aspects of this model appear to be analytically 
tractable so this rewiring model may prove to be as useful the Erdos-Reyni random 
graph. 

As noted in the introduction, the model also has a wide range of practical 
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Figure 4: Plots of the degree distribution, normalised by the sum of values for degree 
greater than zero, and the fractional error of the data w.r.t. the exact solution. For each 
parameter set plots shifted by a constant controlled by A for clarity. For E = 100 but 
with new artifacts added with probability p = 1 — Pp {Pr = 0) where p = 0.1 (crosses, 
A = 0), 0.01 (circles, A = 1), 0.005 (squares, A = 2) and 0.001 (stars, A = 3). The lines 
are the relevant equivalent mean field solutions. Measured after 10^ rewiring events, and 
averaged over 10"^ runs. Started with n{k = 1) = E but otherwise n{k) = 0. Errors on 
the degree distribution are not shown. 

applications O HI [5l O [3 [9l [12l [HI [15]. While it may be too simple in practice, it 
does at worst give a useful null model against which to test other hypotheses. 

However copying the choice of others could also be a genuine strategy, even if it 
emerges as the result of a more fundamental process. Suppose that the individuals 
are connected to each other by a second network. When making the choice of 
artifact for attachment, the individual which is rewiring its edge could consult its 
acquaintances as represented by this network, and may well choose to follow their 
recommendation, i.e. copy their artifact. Such random walks on a network, even 
when of length one, lead naturally to the emergence of preferential attachment in 
most cases, |18) . This explains results in a model of the Minority Game [lOj . There 
individuals are connected by a random graph and choose a strategy (the artifact) 
by copying the 'best' of their neighbours. If what is best is continually changing 
then for the degree distribution this will be statistically equivalent to copying the 
strategy of a random individual. It is no surprise then that the results for the 
popularity of strategies in [10] follows a simple inverse power law with a large 
degree cutoff. 

Finally one may consider the scaling properties of the model. In examples such 
as pottery styles or dog breeds, the categories assigned by investigators are a coarse 
graining imposed on a collection where each individual is really unique at some 
level. However one would hope that the results are largely independent of this 
categorisation. So suppose the artifacts are paired off at random. The decision to 
copy or to innovate on a given event do not change, so Pr,Pp and p remain the same. 
Because preferential attachment is linear in degree, the probability of preferentially 
attaching to a given pair of artifact vertices is just proportional to the sum of their 
degrees which in turn is just the degree of the artifact pair vertex. Thus we retain 
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preferential attachment. The probabihty of choosing one of a pair of artifacts at 
random is double choosing just one at random but this reflects that the number of 
artifact pairs = N/2 is just half the original number of artifact vertices. Overall, 
the form of the equations for the degree distribution of these pairs, n2{k), is exactly 
as before and the only parameters which change are N N/2 and (k) {k)/2. 
Thus the generic form of the distribution of artifact choice is independent of how 
artifacts are classified though the detailed prescription changes in a simple manner. 

I thank D.Brody, H.Morgan, A. D.K.Plato and W.Swanell for useful conversa- 
tions. 
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